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In this article, two problems associated with the expectation that teachers use 
contemporary assessment techniques are examined. The first problem relates to 
teachers' sense-making of assessment data. Illustrative cases revealed that 
teachers' processes of interpretation of students' understanding, knowledge and 
learning of mathematics draws on a rich knowledge base of understandings, 
beliefs, and attitudes. Consequently, the process of sense-making of students' 
mathematical understandings involves ambiguity and difficulty. The second 
problem relates to ways of helping teachers adopt contemporary assessment 
approaches. A professional development activity served as the example 
examined. Three aspects of what the course instructor promoted with respect to 
contemporary assessment were analysed: (1) the assessment methods and tools 
advocated in the course, (2) the degree to which the integration of assessment 
with instruction was promoted, and (3) the purposes for assessment highlighted 
in the course. It appeared that attention was paid to the use of contemporary 
assessment tools, but this was associated with traditional assessment purposes. 
Learning to use the new assessment tool did, however, influence instruction and 
fostered greater integration of assessment and instruction than before — a 
characteristic of contemporary assessment. The article concludes with a 
discussion of the current expectation that teachers use assessment data to 
improve instruction. 


At the heart of the current attempt of fhe mafhemafics educafion 
communify fo reform sfudenf assessmenf lies fhe assumpfion fhaf 
assessmenf dafa can be a powerful fool fo improve learning. Indeed, in fheir 
exfensive survey of fhe research liferafure. Black and Wiliam (2000) 
concluded fhaf innovafions which include sfrengfhening fhe practice of 
formative assessmenf produce significanf, and offen subsfanfial, learning 
gains. However, fheir survey, as well as ofher recenf publicafions on fhe 
issue of assessmenf (e.g., Shepard, 2001), reveal fhaf liffle is acfually known 
abouf whaf if mighf mean in pracfice fo use assessmenf dafa fo improve 
insfrucfion. Shepard, in her comprehensive overview of fhe role of 
classroom assessmenf in feaching and learning, poinfed fo a missing link 
befween confemporary ideas abouf assessmenf and whaf is acfually known 
abouf applying fhem in pracfice: "Alfhough confemporary rheforic implies 
fhaf a shared imdersfanding exisfs abouf whaf if means fo use assessmenf 
dafa fo improve insfrucfion, examples offered suggest considerable ambiguity 
[emphasis added]" (Shepard, 2001, p. 1093). 


1 An earlier version of this paper was presented at ICME-10 - TSG27 in Copenhagen, luly 2004. Time to 
prepare this paper was partially funded through a Quality Learning Research Priority Initiative of Deakin 
University, Australia. 
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The aim of this article is to contribute to the current discussion on 
assessment by examining two problems associated with the expectation that 
teachers use assessment data to improve instruction. The first problem is 
related to teachers' sense-making of assessment data; the second with ways 
to help teachers adopt contemporary modes of assessment. In this article 
relevant background literature pertinent to the context of contemporary 
assessment is presented, followed by illustrative data from previous research 
studies and professional development work to highlight the two problems. 

Background Literature: Traditional and 
Contemporary Assessments 

The traditional assessment approach is underpirmed by behaviourist 
learning theory and the psychometric paradigm; contemporary assessment 
is based on constructivist and socio-cultural learning theories (Shepard, 
2001). Traditional and contemporary assessments differ on three main 
dimensions: the degree of integration of assessment with instruction; the 
methods and tools used for assessment; and the purposes of assessment 
(Birenbaum, 1997; Black & Wiliam, 1998, 2000; Clarke, 1997; Clarke, Clarke, 
& Lovitt, 1990; Lewy, 1996; National Council of Teachers of Mathematics 
[NCTM], 1995, 2000; Shepard, 1989, 2001). These differences are elaborated 
below. 

Integration of Assessment with Instruction 

Traditionally, students are assessed by a separate activity (a test) specifically 
designed for this purpose. In other words, the activity of instruction and the 
activity of assessment do not coincide. The teacher assigns students a task 
either as a learning activity or to evaluate their learning, but not for both. In 
contrast, an important characteristic of contemporary assessment is that 
teachers need to derive much of the information on student performance and 
achievement during the process of regular instruction in order that 
"assessment that enhances mathematics learning becomes a routine part of 
ongoing classroom activity rather than an interruption" (NCTM, 1995, p. 13). 
In such a case, the activities of instruction and assessment often happen 
simultaneously, and assigning students a task would serve both functions — 
advancing as well as assessing student learning. 

Methods and Tools of Assessment 

Traditional assessment aims to provide an accurate account of students' 
knowledge. The tools and methods used for gathering evidence and for 
making inferences emphasise positivistic principles such as objectivity, 
content coverage, precision, and the scientific validity of measurements. The 
prevailing tool in traditional assessment is paper-and-pencil tests made up of 
short standard items with closed question formats concentrating mainly on 
rote recall and mastery of factual knowledge. The methods used for making 
inferences are formula-based, such as counting miscues, and are aimed at the 
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scientific measurement of ability and the avoidance of subjectivity that might 
be involved when making a more holistic evaluation. 

The contemporary view that assessment should be an integral part of 
instruction, combined with disappointment from the limited information 
received from traditional paper-and-pencil mathematics tests, entails the use 
of assessment methods, tools, and techniques different from those common 
to traditional assessment. Consequently, in addition to paper-and-pencil 
tests administered at specified times, contemporary assessment uses a 
combination of various assessment methods and tools that not only provide 
a more comprehensive, rich, and multi-dimensional account of what 
students know and understand, but also serve as powerful instructional 
tools. Included, for example, are projects, portfolios, journals, conversations, 
and observations (e.g., Clarke, Clarke, & Lovitt, 1990; NCTM, 2000; 
Romberg, 1995; Shepard, 2001). Consequently, contemporary-based student 
assessment draws upon a complex combination of formal-structured and 
informal-flexible assessment techniques and methods. 

Purposes of Assessment 

The degree of integration of assessment with instruction, as well as the 
methods and tools used for assessment, are related to the purposes of 
assessment. Traditional assessment centres on summative assessment, that 
is, on evaluating students' achievement at the end of a period of instruction. 
Its main purposes are: certifying students' attainment at the end of a period 
of instruction, and classifying or ranking students. Grades are mainly 
addressed at external authorities such as principals, superintendents, and 
higher education institutes. Contemporary assessment moves from sole 
concentration on summative assessment towards an emphasis on formative 
assessment with the main purposes of advancing students' learning and 
informing teachers as they make instructional decisions. Advancing 
students' learning could be based on student self-assessment and peer- 
assessment, but these do not necessarily include providing teachers with 
information for instructional decisions. The use of assessment data to make 
instructional decisions (e.g., adapting the pace of instruction accordingly, 
choosing wisely among various materials, challenging student thinking, etc.) 
is aimed, eventually, at advancing students' learning. The following section 
of this article concentrates on this purpose of contemporary assessment — 
informing teachers as they make instructional decisions — ^by focusing on a 
problematic characteristic of teacher sense-making of assessment data. 

Problem 1: Teacher Sense-Making of Assessment Data 

Below is a brief analysis of four episodes of teacher-student classroom 
interactions. For an extended description of these episodes see Even and 
Wallach (2004). The analysis of the four episodes exemplifies cases when 
teachers did not understand things said or done by students. For each 
episode the analysis suggested one resource that could have contributed to 
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the teachers' misunderstanding of their students. Choosing to highlight only 
one resource was for fhe purpose of demonsfrafion only, and does nof imply 
fhaf ofher resources mighf nof have confribufed fo fhe nafure of fhe feachers' 
undersfandings . 

The firsf two episodes analysed below appear in Robinson (1993). In her 
sfudy Robinson observed and documenfed several 7fh grade feachers feachrng 
rnfroducfory algebra; she also collecfed lesson plans and inferviewed fhe 
feachers affer each lesson. The fhird episode appears in Goldenberg (2000). As 
fhe insfrucfor of a professional developmenf course for elemenfary school 
feachers Goldenberg sfudied changes in participating feachers' conceptions 
and practices based on audio-fapes of course sessions, collecting various 
arfefacfs produced during fhese sessions, inferviewing fhe feachers, examining 
fhe porffoUos fhe feachers prepared, and keeping a journal in which she 
described fhe course sessions and her reflections on fhem. The fourfh episode 
appears in Wallach and Even (2002). This sfudy examined feachers' 
rnferprefafions of sfudenf falk and actions when solving a mafhemafics 
problem, and was based on observations of, and rnferviews wifh, primary 
school feachers who parficipafed in a professional developmenf workshop. 

Episode 1: Having a Plan 

Bermy was a novice feacher who found if overwhelming fo pay affenfion fo 
sfudenfs' unexpecfed discussions. He had planned fo feach fhaf if is difficulf 
fo subsfifufe numbers in a complicafed algebraic expression, and fhaf if is 
fherefore worfhwhile simplifying fhe complex expression info a simpler, 
equivalenf one. 

I 

He asked fhe sfudenfs fo subsfifufe a = y in each of fhe fwo expressions: 

, „ + 6 + 5fl 

4fl + 3 and . 

2 

Unexpecfedly, fhe sfudenfs began fo debafe how one could decide if fwo 
algebraic expressions were equivalenf. This, of course, was a differenf fask fo 
fhaf infended by fhe feacher and fhe sfudenfs were nof doing as fhe feacher 
had plarmed. However, on fheir own inifiafive, fhey were engaged in a 
genuine and imporfanf mafhemafical discussion. The feacher, however, 
adhered fo his original plan acting as if he had nof heard his sfudenfs af all, 
and making a complefely unrelafed conclusion: "We can conclude fhaf if is 
difficulf fo subsfifufe numbers in a complicafed expression and fherefore we 
should find a simpler equivalenf expression." The feacher ignored fhe 
sfudenfs' discussion enfirely, apparenfly because he was unable fo deviafe 
from his lesson plan. He was nof funed info hearing fhe sfudenfs beyond fhe 
level of whefher fhey were "wifh him" or nof. His hearing of fhe sfudenfs 
seemed fo be consfrained by fhe facf fhaf he was lisfening /or somefhing 
rafher fhan to fhe sfudenfs' discussion. Davis (1996, 1997) defined fhis mode 
of lisfening as evaluative listening. In fhis case, such lisfening prevenfed 
Bermy from attending fo his sfudenfs' fhinking. 
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Episode 2: Lacking Knowledge about Students' Ways 
of Learning Mathematics 

Later in the year Benny was teaching his students how to simplify algebraic 
expressions. In spite of his greaf efforf fo explain how to do this correctly, his 
students kept making mistakes such as "simplifying" 5m + 2 fo 7m. The 
tendency to conjoin or "finish" algebraic expressions is well documented in 
the literature and is often known to more experienced teachers (Tirosh, Even, 
& Robinson, 1998). Benny sensed that there was a problem, but not being 
familiar with students' common conceptions and ways of learning algebra, 
he could not identify the nature or the source of the problem. Consequently, 
he did not "hear" some aspects of what his students were doing, and his 
explanations of the mathematics did not address their difficulties. 

Episode 3: Not Valuing Students' Ways of Thinking 

Ahuva was an experienced teacher who did not understand the solution to 
a fraction problem that one of her studenfs had provided on a test. Because 
she did not expect this particular student to come up with a novel solution, 
she did not think it worthwhile probing him on his way of thinking. 
Instead, all the teacher did was to mark his solution as wrong. Only after 
the student came to tell her that he had checked his solution with his father 
at home and that both he and his father thought that the solution was 
correct did the teacher decide to look at the solution more closely and to 
probe the student about his way of thinking. It was then that the teacher 
"tuned in" to hear her student and adopted a mode of listening which 
Davis (1996, 1997) termed interpretive listening, moving from not hearing 
the student to hearing him, and finally understanding his very original 
way of solving the fraction problem. The teacher needed to believe that 
there was something to hear, and to become aware of the fallibility of her 
own sense making of sfudenfs' work. 

Episode 4: Having a Specific Mathematics Solution in Mind 
Affer solving a mathematics problem, Ruth observed two of her fourfh grade 
students solve the same problem. When discussing their solution with an 
interviewer it appeared that she had "heard" things that were not said by the 
students, as well as not noticing other things that the students did. 
Consequently, she described their solution processes in ways that were quite 
different from what the data had suggested to the researchers who had more 
time to examine them. 

For example, students were asked to show that there was no solution to 
the problem: "Divide 15 players into two groups, so that in one group there 
are 4 players less than in the other group." The only thing that the students 
said was: "Because the number 15 is odd and the number 4 is even, then it's 
impossible." But the teacher, with great confidence, attributed a specific 
meaning to this quite vague statement, quoting their solution as if they had 
said: " . . .If you fake away an even number from an odd number, then you are 
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left with an odd number, which you cannot divide by 2." This interpretation 
was very similar to the way she had solved the problem before observing the 
students. 

When the students worked on changing the number of players so that 
there would be a solution to the problem, the teacher could not understand 
their solution process. What the students did was to build two groups of 
player numbers, 3 and 7, that satisfied the specified condition. The teacher, 
however, had used a different strategy to solve the problem before observing 
the students solve it. She had removed the minimum number of players to 
arrive at a number that would satisfy the specified condition and reached the 
solution of 14 players. Distracted by her own solution strategy, the teacher 
was unable to "hear" her students. 

Hearing Through... 

The analyses of the four episodes above were in line with the findings of 
several other research studies which have suggested that the interpretation 
of students' understanding, knowledge, and learning of mathematics is a 
difficult task for teachers (e.g.. Ball, 1997; Cobb, Wood, & Yackel, 1990; Coles, 
2001; Crespo, 2000; Davis, 1997; Morgan & Watson, 2002; Nicol, 1999; 
Wallach & Even, 2002; Watson, 2000). The studies have begun to reveal the 
complexity associated with listening to students and with teachers' attempts 
to understand what students are saying, showing, feeling, and doing. Ball 
(1997), for example, showed how a teacher's own ways of understanding the 
subject matter and her commitment to her students influenced the ways in 
which she understood the students. Morgan and Watson (2002) argued that 
when teachers assess students' mathematical performance they rely on 
various resources, for example, on their personal knowledge of mathematics 
and the curriculum, on their feelings toward mathematics based on their 
personal mathematics history, on their expectations of how mathematical 
knowledge can be communicated, and on their expectations of students and 
classrooms in general, and of individual students. 

Extending this idea. Even and Wallach (2004) introduced the term 
hearing through when claiming that teachers always "hear students through" 
their personal and social resources. Eor the sake of clarifying the notion of 
hearing through, only one resource that contributed to the teachers' 
misunderstanding of their students was highlighted in the analysis of each 
of the episodes above: the teacher's plan for the lesson, the limited 
knowledge about the nature and possible sources of students' tendency to 
"finish" algebraic expressions, the teacher's low expectation of a specific 
student, and the teacher's own way of solving the mathematics problems she 
presented to her students. But research (Ball, 1997; Morgan & Watson, 2002; 
Wallach & Even, 2002) as well as common sense imply that the interactions 
of various resources influence the nature of teachers' understandings of their 
students' talk and actions. 
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As can be seen, teachers' sense-making of student understanding, 
knowledge, and learning of mathematics is an active process of 
interpretation that draws on a rich base of knowledge, beliefs, and attitudes, 
and can involve ambiguity and difficulties. Thus, understanding what 
students are saying and doing should not be regarded as unproblematic nor 
as something certain. This implies that the purpose of contemporary 
assessment to inform teachers as they make instructional decisions is much 
more complex than might be anticipated. 

Recent research on professional development (Even & Tirosh, 2002) has 
suggested that teachers can improve their understanding of what their 
students say, write, and do by learning to be more open to unexpected events 
in the classroom, by learning about students' common misconceptions, by 
learning to attribute more value to students' original solutions and paying 
more attention to their processes of solving problems, and by transforming 
listening modes from evaluative to interpretive. But does better 
understanding of students' talk and action necessarily imply use of this 
information to improve instructional decisions? This leads to the other 
problem related to current expectations that teachers embrace contemporary 
assessment: how teachers are helped to adopt and use contemporary 
assessment. This problem will be examined by analysing an illustrative case. 

Problem 2: Ways of Helping Teachers Adopt 
Contemporary Assessment 

The case analysed here is a professional development course for in-service 
primary teachers who were taught how to incorporate the use of portfolios 
into their assessment practices. The focus of the analysis is on what the 
course instructor promoted with regard to contemporary assessment, and 
not on what the participating teachers learned about portfolio assessment. 
Three aspects are analysed: the assessment methods and tools advocated in 
the course; the degree to which integration of assessment with instruction 
was promoted; and the purposes of assessment highlighted in the course. 

The data sources for the analysis were: the comprehensive 
documentation of the intervention by the course instructor based on the 
instructor's journal, the portfolios the teachers prepared, individual 
interviews the instructor conducted with each teacher at the begirming of the 
course and at the end (Goldenberg, 2000), and numerous conversations the 
author of this article had with the course instructor during the 
implementation of the professional development course. 

General Description of the Course 

The five-month (56 hour) course on Building Portfolios in Mathematics in the 
Topic of Non-Negative Rational Numbers was part of a larger project aimed 
at preparing teacher-leaders for primary school mathematics education. The 
participants were 16 grade 5 and 6 teachers. Each was from a different school 
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and had been chosen by their principal to lead the mathematics education in 
the school. The course took place in a regional teacher centre. 

The course centred on deepening the teachers' mathematical knowledge 
of non-negative rational numbers, exposing the teachers to mathematics 
education research in this area, and acquainting them with portfolios in 
school mafhematics. More specifically, the course objectives, as stated by its 
instructor, were to: 

• deepen the teachers' mathematical knowledge in the area of non- 
negative rational numbers; 

• advance the teachers in understanding students' ways of thinking; 

• expose the teachers to the existence of students' misconceptions in 
the area of non-negative rational numbers and possible sources for 
fhese conceptions; 

• raise the teachers' awareness of fhe importance and contribution of 
knowledge of students' ways of thinking in general and students' 
misconceptions and possible sources for these conceptions; 

• raise the teachers' awareness of the contribution, for the student 
and for the teacher, of incorporafing explanations and justifications 
into the solutions of assessment tasks; and 

• guide the teachers in building portfolios in mathematics with their 
students. 

The instructor explained that throughout the course the teachers had solved 
mathematical tasks, documented their ways of thinking, and explained and 
justified their solutions. They were also exposed to research findings relafed 
to students' ways of thinking about non-negative rational numbers, to 
students' misconceptions and theories that explain the sources of fhese 
conceptions, and to the constructivist approach that views mistakes as an 
integral part of fhe learning process thaf can be used as a springboard to 
learning. The teachers also learned what a portfolio was, and builf porffolios 
with their students. As a final assignment task for the course, each teacher 
built a personal portfolio thaf included a selection of af leasf fhree tasks from 
fheir students' portfolios including the students' solutions, the teacher's 
assessment of the students' mathematical knowledge as exhibited in the 
solutions of fhe tasks, and the teachers' explanations of the selection of the 
items included in their personal portfolios. 

Assessment Methods and Tools Advocated in the Course 

As fhe title of the course suggests, the main assessment tool advocated in the 
course was the portfolio. The teachers learned what a portfolio in 
mathematics might be, its aims, principles and ways of implementing it with 
students. The course instructor advocated a portfolio that would represent 
the mathematical profile of fhe sfudent: his/her efforts, progress, and 
achievements. The portfolio promoted in the course was composed of two 
components. One component, which received only minor attention during 
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the course, was a mathematical autobiography of the student owner of fhe 
porffolio. The autobiography was fo include fhe sfudenf's personal 
experience in learning mafhemafics, and pasf and presenf supporfing and 
impeding facfors in learning mafhemafics. 

Mosf of fhe work wifh fhe feachers during fhe course was direcfed af fhe 
ofher componenf of fhe porffolio — a selection of mafhemafical fasks fhaf fhe 
portfolio owner solved during fhe year. Each fask would be accompanied by 
fhe reasons for choosing if fo be included in fhe porffolio, and wifh 
documenfafion of fhe fhoughf process fhaf led fhe sfudenf fo fhe solufion. 
The documenfafion would also include difficulfies encounfered, 
explanafions, and jusfificafion of fhe solufion, and so on. 

The mere idea of using a porffolio as an assessmenf fool was foreign fo 
fhe participating feachers. Whaf was mosf profound for fhe feachers was fhe 
move from assessing the correctness of fhe final answer fo assessing fhe 
solution process, and from expecting students to use the algorithms taught in 
class to them looking for differenf and irmovafive solufion processes. Before 
the course the teachers had assessed students' mathematical knowledge 
using only examinations and tests that included tasks that required students 
to use learnt algorithms that produced specific answers. Sfudenfs were nof 
asked fo explain or jusfify fheir answers, and fhe feachers assessed only fhe 
use of fhe algorifhm and fhe degree of correcfness (complefe, parfial, or 
wrong) of fhe final answer. During fhe course, mosf feachers changed fheir 
approaches (fo varying degrees) and began focusing on fhe solufion process, 
accepting as correcf solufions fhaf were nof based on algorifhms learned in 
class. For example, a feacher gave fhe following problem in a fesf: "How 
many eighths do you need to add to 1^ to get 4 j?" 

In her personal portfolio fhe feacher included fhe following solufion 
from one of her sfudenfs. Hagai: "I know fhaf fo gef fo 4 you add 2^ and fhen 
\ more and you gef 2| which is 22 eighfs". In her assessmenf of fhis solufion 
fhe feacher wrofe: 

Hagai added verbal explanations instead of exercises. Previously, I would 
not have accepted this kind of solution as a complete solution. Today I see 
it as an excellent solution because what is important is that Hagai 
understands and knows how to solve. 

As can be seen. Hagai used a non-conventional method of solufion described 
verbally, and nof fhe faughf algorifhm for mixed fracfion subfracfion 
presented symbolically. Confrary fo previous years, she explained, fhe 
feacher nof only accepfed fhe non-convenfional solufion, she even fhoughf 
fhaf if was "an excellenf solufion" because if showed fhaf "Hagai 
undersfands and knows how fo solve." Whaf became imporfanf was nof fhe 
use of fhe faughf algorifhm, buf rafher whefher fhe sfudenf undersfood. 

Degree of Integration of Assessment with Instruction Promoted 

No explicif discussions were conducfed during fhe course on fhe issue of 
infegrafion of assessmenf wifh insfrucfion. Buf fhe mafhemafical items 
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included in the students' portfolios were to be chosen by the students from 
fasks conducfed in class or af home af differenf fimes during fhe year: 
examinafions, worksheefs, personal or group projecfs, and so on. And 
indeed, many of fhe fasks sfudenfs chose fo include in fheir porffolios were 
fasks which were parf of regular class-work or homework, nof fasks fhaf 
were designed for fhe purpose of assessmenf only; nonefheless, some ifems 
were from fesfs. In fhis regard, insfruction and assessmenf were infegrafed. 
For example, one of fhe feachers gof very excifed when she learned how fo 
solve fhe following problem in a sysfemafic way during fhe course, and 
decided fo bring if fo her class. 

Pencils and Scissors 

Scissors cosf 4^ Shekels and pencils cosf 3 Shekels each. You can buy af 

mosf four pairs of scissors and four pencils. 

1. Whaf would be fhe cheapesf purchase? 

2. Whaf would be fhe mosf expensive purchase? 

3. Specify all fhe ofher possibilifies. 

4. Is if possible fo buy differenf ifems for fhe same amounf of money? 

If if is, specify all fhe possibilifies. 

5. Explain all sfeps in your fhoughf process. 

One of fhis feacher's sfudenfs chose fo include fhis problem in his porffolio 
with two different methods of solufion fhaf he used. He explained fhaf he 
worked very hard fo solve fhe problem. Af hrsf he lisfed all fhe possibilifies 
of buying pencils only, fhen all possibilifies of scissors only, and finally, 
pencils and scissors, and scissors and pencils. The sfudenf said fhaf in fhe 
middle of fhe work he gof confused, became fired, and did nof finish fhe 
solufion. Then fhe feacher faughf fhe class a sysfemafic way fo solve fhe 
problem fhaf was based on organising all fhe dafa info a fable which clearly 
presenfed all fhe buying possibilifies for fhe same amounf of money. The 
sfudenf became very excifed abouf fhe new mefhod. He used if fo solve fhe 
problem again, and found misfakes fhaf he had made when he firsf 
affempfed fo solve if. In his explanafion for including fhe problem wifh fhe 
two solufions in his porffolio, he said fhaf he chose fhis fask because "I 
learned an easy and shorf way for solving if and I like shorfcufs." 

Anofher way fhaf assessmenf and insfruction were infegrafed was 
relafed fo fhe qualify of fhe fasks. Af fhe begirming of fhe year fhe feachers 
used only fasks requiring sfudenfs fo use a leamf algorifhm fhaf produced a 
unique numerical answer for class insfruction as well as for assessmenf. 
Sfudenfs were nof asked fo explain or justify fheir answers. The course 
emphasised assessmenf of fhe process of solufion and nof of fhe final answer 
only. For fhaf, fhere was fhe need fo presenf sfudenfs wifh open-ended 
problems allowing for differenf solufion mefhods — irmovafive as well as 
previously learnf — and which required sfudenfs fo explain fheir fhoughf 
process. Consequenfly, quife a few of fhe feachers modified fhe fasks fhey 
had previously used in class insfruction so fhaf fhey were more open-ended 
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and also required students to explain their solutions. For example, in 
previous years a teacher had used the following textbook problem for 
insfruction: 

A housekeeper cleaned | of the 10 windows in her house. How many 
windows did she clean? 

In the middle of fhe year of fhe course, fhe feacher modified fhis problem 
and used fhe new version for insfrucfion. Nofe how she changed fhe confexf 
as well: 

A family invited a cleaning company to clean its new apartment. On the first 
day the company managed to clean | of the apartment windows (a whole 
number of windows). 

1. What part of the total number of windows was not cleaned on the 
first day? 

2. Suggest three possibilities for the number of windows in the apartment. 

3. For each possibility calculate the number of windows cleaned on the 
first day. 

4. Explain in writing the thought process that led you to the solution. 

Assessment items were often also used for insfruction. Consequently a 
qualitative change in the assessment items implied, to some degree, a 
qualitative change in the instructional items. Yet, the two activities did not 
happen simultaneously. The teachers' use of fhe porffolios for assessmenf 
did nof happen during instruction. Rather, the portfolios were collecfed and 
assessed only af fhe end of fhe year. In fhis regard, insfrucfion and 
assessmenf were nof infegrafed fime-wise. 

Assessment Purposes Highlighted in the Course 

The use of porffolios for assessmenf purposes was presenfed by fhe course 
insfrucfor as a better way fo assess sfudenf achievemenfs. She explained: 

When using a portfolio to assess achievements [emphasis added], one 
assumes that [the use of] several measures is better than one measure. To 
do this, there is a need to set clear criteria for the teacher and for the 
student regarding the choice of materials for the portfolio and its 
assessment. (Goldenberg, 2000, p. xxiv) 

She added that it was recommended that the decision on the criteria for 
assessing the portfolio would be the shared decision of the teacher and 
students. As the portfolio was to be assessed at the end of the school year, it 
can be said that it was used for the traditional assessment purpose of 
certifying students' attainment at the end of a period of instruction. In this 
regard, there was a mix of a traditional purpose with a contemporary tool. 
The use of portfolios for assessment enables a more comprehensive and 
multi-faceted account of students' achievements, and also allows students to 
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have a non-traditional, active role in deciding what and how it would be 
assessed. Nonetheless, its purpose is consistent with summative assessment. 

Yet, the course in which the teachers were taught how to use portfolios 
for assessing sfudenf achievemenfs did more fhan fhaf. The emphasis on fhe 
imporfance of assessing sfudenfs' fhoughf processes, and sfudenfs' 
(mis)concepfions and fheir sources did nof remain cormecfed only fo 
summafive assessmenf. As menfioned above, in confrasf fo previous years, 
during fhe year of fhe course feachers sfarfed fo ask sfudenfs fo explain fheir 
solufion processes, in addifion fo providing a final numerical answer. Af 
firsf, sfudenfs did nof offen cooperafe, and did nof explain how fhey 
reached fhe final answer. Consequenfly some of fhe feachers concluded fhaf 
fhis was somefhing fhey needed fo work on in class. For example, one of fhe 
feachers said: 

1 think that in order for me to get explanations I need to coach them more in 
giving explanations. I guess I did not work enough in class on explanations 
and justifications. This way the students will better understand and I will 
better understand what they know. 

And indeed, some of fhe feachers used fhe informafion fhaf sfudenfs did nof 
explain fheir solufion processes fo make fhe insfrucfional decision fo focus 
on fhaf aspecf during insfrucfion — a formafive confemporary assessmenf 
purpose. 

Sfill, in fhe course, no explicif focus was puf on how fo use fhe 
informafion on sfudenfs' fhoughf processes, and (mis)concepfions and fheir 
sources fo make appropriafe insfrucfional decisions. To illusfrafe fhis, a 
feacher's assessmenf of fhe solufions of fwo of her sfudenfs (Udi and Anaf) 
fo fhe following problem are examined: 

In March the number of dogs in an animal shelter was ^ more than the 
number of cats. 

• Suggest at least two possibilities for the number of dogs and the number 
of cats that were in the shelter in March. 

• Explain your thought process. 

Udi's solution 

I constructed a table and thought there would be 18 cats. Then I saw that I 
didn't get a whole number of dogs. I tried with 20 and with 23 and saw that 
with 23 it is also not a whole number. So I thought that the number of dogs 
should be a number with a zero at the end. 

Dogs Cats 

18 + 3f = 2l| 18 

20 + 4 = 24 20 

23 + 4f = 27f 


23 
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The teacher's assessment 

Udi has mastered the operations of addition and multiplication of fractions, 
knows how to find the value of the part when the whole is known . . . He was 
asked to suggest two possibilities for the number of dogs and cats. Didn't 
do it but reached a generalisation. Although not correct, or better said a 
partial generalisation: 'the number of dogs should be a number with a zero 
at the end.' Actually it could also be a number that ends with the digit five. 

Anat's solution 

To the number of cats you add g and get the number of dogs. For example, 

3 cats and 3^ dogs. 10 cats and 10^ dogs. 

The teacher's assessment 

Anat understood that the number of dogs is greater than the number of cats, 

'if more then you need to add' (addition enlarges — we saw similar 
conception in research studies). She does not understand the meaning of 
more than the number of cats.' She also does not pay attention to the results 
she reached, the number of dogs must be a whole number, the number 3g 
does not have a meaning when we talk about the number of dogs. 

As can be seen, the teacher "heard" Anat's solution through her knowledge 
of research findings in the area. This suggests that children often use verbal 
hints when solving mathematical problems and, for example, perform 
addition when the problem they are solving includes the word "more". 

But, how might the teacher use her assessment of Udi and Anaf's 
undersfandings fo make insfrucfional decisions? In Udi's case fhe feacher 
said, "If Udi forgof fhe divisibilify rule for five, if seems fhaf fhere is a need 
fo repeaf fhis fopic in class." In Anaf's case fhe feacher said, "I will have fo 
work in class on fhe issue of checking and on fhe reasonabilify of answers." 
Thus, in bofh cases when fhe sfudenfs exhibifed a difficulfy, fhe feacher 
decided fo work on fhis in class. Was fhaf a good insfrucfional decision? Was 
Udi's real problem fhaf he forgof fhe divisibilify rule for five? If could be fhaf 
he did know fhaf a number is divisible by five if if ends wifh a zero or wifh 
a five, buf did nof use fhis knowledge when solving fhe dogs and cafs 
problem. If fhis was fhe case, would if be useful fo repeaf fhe fopic in class, 
as suggesfed by fhe feacher? Checking fhe reasonabilify of final answers is an 
imporfanf problem-solving sfrafegy. Whaf are fhe effecfive ways fo feach fhis 
sfrafegy? Would fhis be a difficulfy for fhe whole class or only for Anaf who, 
fhe feacher said "is a sfudenf wifh difficulfies who lacks mofivafion"? And 
would if indeed be fhe main difficulfy for Anaf in fhis case? Such information 
is imporfanf for making insfrucfional decisions on appropriafe ways fo work 
in class. Nonefheless, fhe course did nof deal wifh "fhe nexf sfep" — how fo 
use assessmenf fo make insfrucfional decisions. 
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Conclusions 

Current rhetoric portrays a rather ideal picture about the use of assessment 
data to improve instruction. The literature identifies reading sfudenfs' 
mathematical work, and observing and listening to students when they do 
mathematics as promising assessment means for feachers fo improve 
insfrucfion by making beffer informed insfrucfional decisions (e.g., Clarke, 
Clarke, & Loviff, 1990; Fennema ef ah, 1996; NCTM, 1991, 1995). In confrasf 
fo fhe ideal picfure offen porfrayed, if was argued in fhis arficle fhaf fhis may 
be much more complicafed in practice fhan is, perhaps, anficipafed. 

One problem associafed wifh currenf expecfafions fhaf feachers use 
assessmenf dafa fo improve insfrucfional decisions is relafed fo feacher 
sense-making of whaf sfudenfs say, wrife, and do. This is offen conceived as 
unproblematic (e.g., Birenbaum, 1997; Clarke, 1997; Clarke, Clarke, & 
Loviff, 1990; Lewy, 1996; NCTM, 1995). Buf, "hearing fhrough" carmof be 
overcome — feachers will always hear fhrough fheir resources. Still, 
professional developmenf can confribufe fo improving feacher knowledge 
and disposition so fhaf fhey improve fheir abilify fo make sense of 
assessmenf dafa. The feachers who parficipafed in fhe professional 
developmenf course analysed in fhis arficle improved fheir abilify fo 
undersfand fheir sfudenfs' knowledge by learning abouf: sfudenfs' ways of 
learning mafhemafics; sfudenfs' common misconcepfions; presenfing fasks 
fhaf require sfudenfs fo explain and jusfify fheir solufions; and affribufing 
value fo sfudenfs' original solufions and paying affenfion fo fheir processes 
of solving problems by fransforming fheir lisfening mode from evaluafive fo 
inferprefive (Davis, 1996, 1997). Similar resulfs have been reporfed in 
several research sfudies (e.g.. Even, 1999; Even & Markovifs, 1993; Even & 
Tirosh, 2002; Eermema ef al., 1996; Goldenberg, 2000; Rhine, 1998; Simon & 
Schifter, 1991). 

Improving feachers' imdersfanding of whaf fheir sfudenfs say, wrife, 
and do sfill leaves fhe problem of how fo use fhis undersfanding fo make 
beffer insfrucfional decisions. In facf, fhe liferafure on assessmenf usually 
cenfres on fhe use of irmovafive assessmenf mefhods and fools, such as open- 
ended fasks, journals, porffolios, and observations (e.g., Beyer, 1993; 
Birenbaum, 1997; Carfer, Ogle, & Royer, 1993; Clarke & Sullivan, 1992; 
NCTM, 1995, 2000; Romberg, 1995; Valencia, 1990), buf is sparse on how 
feachers mighf use assessmenf dafa fo make insfrucfional decisions. If 
appears fhaf affenfion is offen given fo feaching feachers how fo infegrafe a 
combinafion of new assessmenf mefhods and fools info fheir feaching, 
insfead of fradifional paper-and-pencil fesfs adminisfered af specified times. 
Buf nof as much affenfion is given fo ways of using fhe richer information 
acquired abouf sfudenfs fo make insfrucfional decisions and advance 
sfudenfs' learning. Rafher, fhe new fools continue fo serve a fradifional 
assessmenf purpose fhaf focuses on cerfifying sfudenfs' affainmenf af fhe 
end of a period of insfrucfion. The use of assessment data to make 
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instructional decisions is treated as unproblematic, as if there is a simple 
connection between understanding what students know and knowing how 
to use this knowledge in instruction. Moving to the next step, of helping 
feachers learn fo use assessmenf dafa for insfrucfional decision-making is nof 
a simple fask, buf is, nonefheless, essenfial. 
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